Stochastic Modeling and Entropy Constrained Estimation of Motion from Image Sequences

We consider the problem of coding video signals using motion compensation and a forward coded dense motion eld. First, we develop a motion estimation technique that yields dense estimates suitable for the coding application; next, we develop a prototype of a video coder, which we use to verify that high coding performance is attainable within our framework. To nd our sought motion estimates, we assume motion in an observed image sequence to be a stochas-tic process, modeled as a Markov Random Field (MRF). The standard Maximum A Posteriori (MAP) estimation problem with MRF priors is formulated as a constrained optimization problem (where the constraint is on the en-tropy of the sought estimate), but then transformed into a classical MAP estimation problem, and solved using standard techniques. A key advantage of the constrained formulation is that, in the process of transforming it back to the classical framework, parameters which in the classical framework are left unspeciied {and often tweaked in an experimental stage{ become now uniquely determined by the introduced entropy constraint. And to verify that our motion estimates are indeed useful for coding, we compare the peformance of a prototype video coder with that of an equivalent coder based on block-matching motion estimates. Experimental results reveal, for various types of video signals and at various rates, that: (a) in terms of PSNR, our system equals or improves upon the performance of full search block-matching; and (b) in terms of visual quality our improvements are signiicant, since our images are completely free of blocking artifacts.